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ABSTRACT 



TRIGEM, a computer-assisted instruction (CAI) course 
developed as a part of Project TAPS (Teaching Anatomy with Programed 
Schematics) is designed to teach the anatomy of the maxillary 
division of the trigeminal nerve. This course is currently 
operational on the Harvard CAI System which uses an IBM S 360/Model 
65 as the central processor, either teletypes or IBM 1050 consoles as 
the student interface, and CAILAN as the interactive language. The 
students also use printed visual aids. A pilot study and a second 
study are described. The studies were designed to compare the 
effectiveness of two different ways of presenting visual information 
while the student is learning and the effect of the student's 
attitude toward CAI on his rate of learning. An abstract of the 
TRIGEM course is appended. The report is supplemented by data tables. 
(Aut.hor/JY) 
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Abstract 




This report details the status of Project TAPS (Teaching Anatomy 
with Programmed Schematics) and summarizes data obtained from two 
studies. This project is t°ing supported by the U. S. Public Health 
Service and is being conducted by the Harvard Computer-Aided Instruction 
Laboratory in cooperation with Harvard Dental and Medical Schools and 
Tufts University Dental School. 

More specifically, this report describes TRIGEM, the CAI course 
developed as a part of Project TAPS to teach the anatomy of the maxillary 
division of the trigeminal nerve. This course is currently operational on 
the Harvard CAI System which uses an IBM S 360/Model 65 as the central 
processor, either teletypes or IBM 1050 consoles as the student interface, 
and CAILAN as the interactive language which operates under OS. The 
students also use printed visual aids. 

A pilot study and a second study are described. The studies were 
designed to compare the effectiveness of two different ways of presenting 
visual information while the student is learning. An abstract of the CAI 
course TRIGEM is included at the end of this report. 
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TAPS 1 



This project was proposed as an investigation into the relative 
effectiveness of two different forms of perceptual support for instruction. 

More specifically, it is :oncerned with improving the learning and retention 
of anatomical information through the programmed presentation of perceptual 
aids to verbal learning in an interactive mode. 

The two types of perceptual supports were schemata and representational 
diagrams. Each was used to support a programmed dialogue presented by a 
computer to a student at a teletype. The instructional program, called 
TRIGEM, was designed to teach terminology and concepts, (see Program Abstract, p. 28) 
The research aim was to compare two conditions of instruction in a 
section of the anatomy course. The comparison of two different ways of 
encoding perceptual information is interesting in that the novel way of 
providing perceptual information could be used extensively if found superior. 



which have been adapted for presentation by the IBM S 360/65 instructional 
system at Harvard University (Fig. 1). The course can be accessed by 
either a standard teletype or an IBM 1050 terminal connected to a 103A2 
dataset. With the cooperation of Dr. William M. Feagans at Tufts Uni- 
versity, five teletypes were installed in a trailer adjacent to the school 
area and connected by telephone lines to the Harvard system. 

TRIGEM consists of two almost identical programs, PF and PD, which 
differ only in the graphic representations used. Program PF uses two 
representational drawings (Fig. 2) taken from Gray’s Anatomy . Program 
PD uses a schematic diagram and identification key (Figs. 3 and 4). 

^An acronym for X eac ^ in g Anatomy with .Programmed .Schematics, 



TRIGEM 



The CAI course TRIGEM is based on programmed instruction materials 




3 




Fig. 1. Hr -vard University computer-based interactive 
instructional system. 
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Fig- 2. The two representational diagrams used in 
Program PD of the CAI course TRIGEM. Reproduced for research 
purposes with the permission of the publishers of Gray's Anatomy, 
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TRIGEMINAL NERVi MXILLARY DIVISION ' 
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The schematic diagram used in Program PF of the CAI course TRIGEM. 



Symbol 



What The Symbol Represents 




nerve root 



/ Z ZZZ3 

maxillary nerve 
rounded forms 



(pyx) 




nerve name 



ganglion 



middle meningeal nerve 






pterygopalatine nerve 



facial branches 



superior alveolar branches 



zygomatic nerve 



Note: 



Breaks in the center of Fig. 
through which the max i liar v 
parentheses . 



3 contain the names of the regions 
passes ; their names appear in ' 



Fig. 4. The 
shown in Fig. 3. 



identif ication key used with the schematic diagram 
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These materials were dry-mounted on heavy cardboard and made available to 
students at the terminal* Each program requires approximately 1 and 1/4 
hours of student time, depending on response rate. 

Pilot Study 2 

Design 

For the purpose of the project, the design proposed made use of four 
groups of students, drawn at random from a first-year class at a dental 
school* Each group was to take the twc parts of the course in a different 
sequence: Group A, PD (see Fig. 2) twice in succession; Group B, PD first 

and then PF (see Fig. 3); Group C, PF first and then PD; and Group D, PF 
twice in succession* However, in this first study it was possible to 
secure only two groups — one taking the program with the schematic diagram 
(Fig. 3) and the other with the traditional material (Fig. 2)* 

All students were asked to fill out an attitude questionnaire and 
take a written test on knowledge of content, both before and after the 
CAI course. The attitude questionnaire was designed to determine a 

student f s attitude toward CAI before and after his use of it as a 

3 

participant in this study. The questionnaire consists of 15 statements, 
to which the student responds "yes," "no," or "maybe, n to indicate 
his degree of agreement. The questionnaire requires about 1 minute to 
complete; its pre- and pcsttest forms are identical except for the verb 
form used, i.e*, future and past tense (see Figs. 5 and 6). 

Students are also given a test question booklet and an answer book- 
let to determine their knowledge of the subject matter presented before 

o 

Spring-semester students at' Tufts Dental School were used, 

3 

This questionnaire was originally developed by Professor Timothy 
Smith, formerly of Florida State University, Tallahassee, Florida. 
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Scale of Attitudes Toward Computers- 




Name ' Date 

School or Center 



1. 


I would learn more quickly by using the computer. 


Yes 


_Maybe_ 


No 


2 . 


I could work at my own speed on the computer. 


Yes 


Maybe 


No 


3. 


It would be interesting to work by computer. 


Yes 


_Maybe 


No 


4. 


It would be easier to learn by computer than with 
a teacher. 


Yes 


_Maybe 


No 


5. 


I would like sitting and working alone. 


Yes 


Maybe 


No 


6 . 


I think students learn better by computer than- with a 


f 








• teacher . 


Yes 


Maybe 


No ■ 


7 . 


It would be easier to learn by computer than with 
films and slides. 


Yes_ 


Maybe 


No 


8 . 


I think students learn better by computer than with 
a book. 


Yes 


Maybe 


No 


9 . 


I have used a typewriter . 


Yes 


A bit 


No 


10. 


I’m afraid I could not learn hovj to use a computer 
very well. 


Yes_ 


Maybe 


No 


11. 


I would need a teacher as I work on the computer. 


Yas 


Maybe 


No 


12. 


I would like to use a computer. 


Yes_ 


Maybe 


Mo 


13. 


Using a computer would be like having a friendly 
teacher. 


Yes 


Maybe 


No 


14. 


Learning by computer would go too fast. 

0 


Yes 


Maybe 


No 


15. 


I would not mind if I missed a question while x-jorking 
on a computer since no one would be watching me. 


Yes 


Maybe 


No 



HCAI/Pre-/4/69 



Fig. 5. CAT Attitude Scale, pretest form. 
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Scale of Attitudes Toward Computers 



Name . ~~ ' ' Date 

School or Center 



1 . 


I learned more quickly by using the computer. 


Yes 


Maybe 


No 


2. 


X worked at my ovm speed on the computer. 


Yes 


Maybe 


No 


3. 


It was interesting to work by computer. 


Yes 


_Maybe_ 


No 


4. 


It was easier to learn by computer than in a class. 


Yes 


_Maybe 


No 


5. 


I liked sitting and working alone. 


Yes 


Maybe 


No 


6. 


I think students learn better by computer than 
with a teacher. 


Yes 


Maybe 


No 


7. 


It was easier to learn by computer than with 
films and slides. 


Yes 


Maybe 


No 


8. 


I think students learn better by computer than 
with a book. 


Yes 


Maybe_ 


No 


9. 


I have used a typewriter. 


Yes 


A bit 


No 


10. 


I'm afraid I did not learn how to use a computer 
■very well . 


Yes 


Maybe 


No 


11. 


I need a teacher as I work on the computer. 


Yes 


Maybe 


No 


12. 


I liked using a computer. 


Yes 


Maybe 


No 


13. 


Using a computer is like having a friendly teacher. 


Yes 


Maybe 


No 


14. 


Learning by computer went too fast. 


Yes 


Maybe 


No 


15. 


I did not care If I missed a question while 
working by computer since no one was watching me. 


Yes 


Maybe 


No 
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Pig. 6. CAT Attitude Scale, posttest form. 
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they start the course. Fig, 7 shows the first page of the booklet with 
rest questions and Fig. 8, the corresponding page of the answer booklet. 
The test booklet contains the questions only, and all answers are written 
in the separate answer booklet. This test measures the behavioral objec- 
tives of the course; consequently, it is a criterion-referenced test and 
yields a fairly thorough measure of the students knowledge of the struc- 
ture, function, and terminology of the trigeminal nerve. There is no 
difference in pre- and posttest forms; both contain 45 items for Part 1, 

28 for Part 2, 21 for Fart 3, and 24 relating to the configuration. 

Since the only difference between the PD and PF programs lies in 
the learning aids they use, it is assumed that any significant difference 
in group average posttest scores on this test is due to a difference in 
effectiveness of those aids, 

Materials 

The PD and PF programs are each divided into four sections. The 
first section of each program provides a description of nerves in general 
and introduces the student to the trigeminal nerve, of which the maxillary 
division, the subject matter of TRIGEM, is a part. 

The second section of each program teaches the branches, or config- 
urations, of the maxillary division. The student first sketches the con- 
figurations of the several component structures of the nerve and then 
combines them to achieve knowledge of the entire structure. 

The third section teaches the names of the nerves and the areas 
supplied by them. In order to aid the student f s understanding and recall 
of this material, an analysis of each term f s Latin components is given, 
together with the English meanings of these components. 
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TEST - Part 1 



Fill in the answers to the following questions in the appropriate space 



on the ANSWER SHEET!! 



DO ROT WRITE IN THIS BOOKLET! 



1. Write the names of the divisions of the trigeminal nerve. Put the name 
of the largest division on the first line, the second largest division 
on the second line, and the smallest division on the third line. 

2. Write the names of all the branches and. branches of branches of the 
maxillary- nerve in the order they separate. Include the name which the 
maxillary nerve attains after entering the orbit. In other words, 
write the name of the first branch in the cranium. Below the name of the 
first "branch write the names of all its branches in order. Then do he 
same for all other branches of the maxillary nerve .in order. You may need 
more or less space than is provided for question 2 on the answer sheet. 

3. In the column titled "3. Area Supplied" on the answer sheet list the 
general area supplied by each nerve or branch you named for question 2. 
List the area supplied in the same row in V7hich the nerve is named. 




Fig. 7. Page 1 of the test question booklet. Pre- and 
posttest forms are identical. 



ANSWER SHEET 
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page 1 



Part 1 



Nana I D . 

It 3. Area Supplied 



2. Nerve Names 







Fig. 8. Page 1 of answer booklet. Pre- and posttest forms 
are identical. 
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The fourth and last section of each program teaches the regions 
through which each of the branches of the maxillary division passes. As 
in the third section, terms are broken down into their Latin components. 

Both programs are of equal length. 111 frames. There are two basic 

4 

frame types, denoted by the abbreviations RD ("read") and QU ("Question") • 

An KD frame requires the student to simply read a paragraph (Fig. 9). 

When he is ready to continue he presses the EOB (End of Block) key, which 
signals the system to proceed with the course. Some RD frames require 
the student to draw a sketch of some region of the trigeminal nerve (Fig, 10), 
A booklet is provided for this purpose; hox^ever, there are electronic 
sketch pads that could be put on-line if that were wanted and could be 
afforded. The booklet used in this study contains blank pages for the 
drawings, alternating with pages on which the correct configurations are 
printed. The student draws his sketch on the designated page of the booklet 
and then turns the page to find the correct answer. When he is 
satisfied that he knows the configuration, he keys EOB and the 
computer proceeds to the next frame. 

The second basic frame type is the QU frame, which requires the 
student to type information as a part cf his reponse. This information 
may be to fill in a blank or answer a direct question. If the answer is 
correct, the computer responds by typing CORRECT and proceeding to the 
next frame (Fig. 11). If the answer is correct but misspelled, the 
computer responds as shown in Figure 12. This response has been designed 



\hese refer to the n op codes” in CAILAN, the CAI language used 
on the Harvard CAI System. 
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COMPUTER: NERVES ARE LONG WHITISH STRINGS OF CELL BODIES 

AMD THEIR "APPENDAGES" WHICH CONDUCT MESSAGES 
FROM ONE PART OF THE ANATOMY TO ANOTHER. THE 
NERVE APPENDAGES ARE THE LONG PART WE USUALLY 
REFER TO WHEN WE SPEAK OF A NERVE. 

STUDENT (v7hen ready to proceed to next frame): (eob) 



Fig. 9. 
TRIGEM, Part 1, 



A typical RD frame from the CAI course 
"general properties of nerves." 



COMPUTER: NOW, WITHOUT LOOKING AT THE DIAGRAM, SKETCH THE 

DIAGRAMMATIC CONFIGURATION FOR ALL THE PTERYGO- 
PALATINE NERVES. DRAW ON PAGE 11 OF THE BOOKLET, 
AND THEN COMPARE YOUR DRAWING TO THE ONE SHOWN ON 
PAGE 12 OF THE BOOKLET. 

STUDENT (after drawing the configuration and checking it): (eob) 



Fig. 10. A typical PJ) frame from the CAI course 
TRIGEM requiring the student to draw a sketch, Part 2, 
"branches and configurations." 
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COMPUTER: LOOK AT THE DIAGRAM. THE PTERYGOPALATINE NERVES 

APPEAR TO FORM THE GANGLION. ACTUALLY 

THEY PASS RIGHT THROUGH THE GANGLION AND DO NOT 
FORM IT. 

STUDENT: PTERYGOPALATINE (eob) 

C: CORRECT ' 



Fig. 11 • A typical QU frame correctly answered 
by the student. 



COMPUTER: ONE BRANCH OF THE POSTERIOR SUPERIOR NASAL BRANCHES 

IS LONGER THAN THE REST. THIS BRANCH IS NAMED ON 

THE DIAGRAM AND IS THE 

STUDENT: NASO PAL I Tl NE (eob) 

COMPUTER: R I GHT--THE NASOPALATINE NERVE. 



Fig. 12. a typical QU frame to which student 
gives a correct but misspelled answer. Note that the 
correct spelling is provided but he doesn’t have to 
spell it correctly. This is the author’s decision as 
a style of teaching. 



COMPUTER: ONE BRANCH OF THE POSTERIOR SUPERIOR NASAL BRANCHES 

IS LONGER THAN THE REST. THIS BRANCH IS NAMED ON 

THE DIAGRAM AND IS THE 

STUDENT: PHARYNGEAL (eob) 

COMPUTER: INCORRECT. THE CORRECT ANSWER IS NASOPALATINE. 



Fig. 13. A typical OU frame incorrectly answered 
by the student. 
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to preserve morale by calling the student 1 s attention to his misspelling 
indirectly, i.e., without actually telling him that he has made an error 
in spelling* The objective is to teach anatomy* Figure ,13 shows one of 
the computer^ responses when the student f s answer contains incorrect 
substantive information. Every time the student f s answer is incorrect, 
the computer tells him he is incorrect, gives him the correct answer, 
and proceeds to the next frame* This is called non-correction procedure * 

It does not require him to make the correct response before he goes on. 
Pilot Study 

In the pilot study which followed the developmental testing of the 
program, six dental students (3-PD, 3-PF) took the course. No student 
took the course twice as called for in the original design because it 
took too long for the time they had available — about two and one-half 
hours. All six students completed the pre- and posttest forms of the 
CAI attitude questionnaire and the achievement test. 

Table 1 summarizes the results obtained from the pre- and posttest 
forms of the achievement test. If we compare the differences between 
pre- and posttest scores for both groups we find that the PD group who , 
studied with the schematic diagram showed the larger gains on Parts 1, 2, 
and the total, but the group that studied with the representational diagram 
achieved bigger gains on Part 3. In general, gains on Part 3 were sub- 
stantially lower than for the other two parts; however, the possibilities 
also are lower. The maximum possible score for Part 1 is 45, for Part 2, 
23, and for Part 3, 21. 
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Scores* made by Six Dental Students on Pre and Post Forms 
of Achievement Test used in TRIGEM Pilot Study 
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The average difference for the PD group is 49*67; the average for the PF group is 3.16. 



Experiment II 




/ 

! 

The study was repeated in the fall of 1969-70 with Harvard students. 

i 

Since they had the same time constraints, two groups were used. One, the 
PD group, had the schematic diagram available during learning and the 
other, the PF group, had the representational figures from Gray*s Anatomy . 

The teletype terminals were installed in a medical school building for 
convenient access. 

Students 

Eighteen students participated and completed all the steps involved. 
Ten were in the PD or schematic group and eight in the PF or figure group. 
Method 

In addition to measuring the information learned we measured attitudes 
Two different instruments x*7ere used (see Figs. 5 and 14). For both, the 
more favorable the attitude the higher the score. One instrument measured 
attitude toward CAI (Fig. 5); the other, attitude toward the learning aid 
and the program (Fig. 14). 

The test of knowledge was the same as used in the pilot study. 

Results 

Cognitive domain, information . The amount learned in terms of 
mean scores is represented in Table 2 and the bar diagrams shown in Fig. 15. 

The data clearly indicate that both groups learned from their 
experience with CAI, and that the amount learned with the schematic was 
somewhat more than the amount learned from traditional drawings. 
Correlational Analyses 



The correlations for the Schematic Diagram Group are given in 
Table 3j the correlations for the Representational Diagram Group are 

given in Table 4; and the entire set of correlations is summarized in 
Fig. 16. 

o 
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Name: 



Student No,: 



School: 



1. How would you rate this method of learning anatomy relative to the 
conventional textbook/lecture method in the following areas? Circle 
one number per line. 

Excellent Good Average Poor Bad 



Effectiveness 
Ease of learning 
Learning speed 
Enjoyment 



1 

1 

1 

1 



2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 



2. How do you think the computer method could best be used in the teaching 
of anatomy? Specifically, should it replace the conventional lecture/ 
textbook/dissection methods, be integrated with them (how?), or not be 
used at all? 



a . 


replace conventional lecture 


yes 


no 


b. 


replace textbook 


yes 


no 


c. 


replace dissection 


yes 


no 


d. 


not be used at all 


yes 


no 



e. other possibility (describe) 



3. How would- you assess the effectiveness of the learning aids used in this course 
with the computer (the schematic diagram or the representational figures or 
both, if you used both)? Circle one number per line. 

Excellent Good Average Poor Bad 

a. schematic diagram 1 2 3 4 5 

b. representational figures 1 23 45 

c. would you use anything 

else? yes no 

If yes, describe. 



4. Criticisms, comments, or suggestions for improving the program: 

a. text suggestions 

b. diagram suggestions 

c. computer system suggestions 

d. other suggestions 



Fig. 14. TRIGEM post-experiment questionnaire designed to 
measure student attitude toward the course materials — the learning 
aid and the program. 
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Means of Students on Pre- and Posttest Under the Two CAI Conditions 
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These differences favor the PD or experimental condition. 



PRETEST, FIGURE GROUP 





Fig, 15, Diagram group vs, figure group: cognitive learning 

as reflected by mean pre- and posttest scores. 



SCORE 



Correlations for the PD (Schematic Diagram) Group 
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Correlations for PF (Representational Diagram) Group 
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PD-schematic group data . Three correlations were significant for the 
PD group which used the schematic diagram: 

a. between amount of verbal knowledge (posttest) and (perceptual 
knowledge) ability to reproduce the learning aid diagram (r = .631) 

b. between pretest attitudes toward CAI and the amount of verbal 
knowledge (cognitive posttest) learned. This was a negative 
correlation (r - -.680). 

c. between what they knew about the course material beforehand and their 
attitude toward the course materials including the learning aid (r - .684) 

These data indicate the following. First, that when the schematic 
diagram is used during learning, the amount of anatomical information acquired 
(posttest) is related to the student T s ability to reproduce the diagram of the 
trigeminal nerve, its branches, and to label its parts and regions. 

Second, the students who had the most positive attitudes toward computers 
before taking the program learned least. 

Third, the students who knew more to start with had the most positive 
attitudes toward the way the course was presented to them. In other words, 
the students who knew the most anatomy when they began appreciated the 
schematic aid most, 

PF group data . There was only one correlation that achieved signifi- 
cance for the PF group. The students with the most positive attitudes toward 
CAI also had the most positive attitude toward the course materials at the 
completion of the CAI course. 

PD vs* PF groups . The three largest differences in 2 score transfor- 
mations of the correlations (see Fig. 16) were:"* 

~*A difference between z transformations of r f s with the size groups 

used are 1.15 for z and 1.50 for z -. These values are based upon H : 

.05 .ol o 

P, = using a two-tailed test. 
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a. CPOST vs. Quest.; 

b. APOST vs, Quest.; and 

c. APRE vs. Quest. 

These data suggest that the schematic diagram as contrasted with the 
anatomical figures: 

a. produced a positive correlation between amount known after V earning 
and attitude about the course; 

b. resulted in a higher positive correlation between attitudes toward 
computers after learning and attitudes toward the course materials * 

c. produced a negative correlation between attitudes about computers before 
learning and attitudes toward the course materials after using them 

to learn 



Summary 

The data from Experiment II confirm those of Experiment I in indicating 
that students learn verbal and perceptual information about the nervous system 
when it is presented to them by CAI (see Fig. 15). 

Where a schematic is used early in learning the students learn both the 
spatial relationships and the verbal information. Those who like CAI most to 
begin with learn least verbal information; those who knew most to begin with 
had the most positive attitude toward CAI afterward. On the other hand, of 
those who learn with CAI using the traditional visual aid the ones who like 
CAI most liked the course most. 

Differences in correlations between some of the same pairs of variables 
were found suggesting that the visual aid that is available during learning 
alters the relationship between these variables. All of these effects 
involved attitudes. 
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Subject Matter: the maxillary division of the trigeminal nerve 



Author(s): based on Johnson, R. P. The effect of mnemonic learning 

aids upon immediate recall of neuroanatomical facts. 
Master's Thesis, University of Illinois, 1966* Adapted for 
CAI presentation by S. H. Desch (Harvard CAI Laboratory). 
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Auxiliary Equipment: Representational diagrams or schematic diagrams 

are given to students before they start the 
program. They are in a booklet. 
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Medford, Mass., Harvard CAI Laboratory, Cambridge, 
Mass., and the Harvard Medical School, Boston, Mass. 
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